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EXPRESS MAIL NO. :EL 627510445 US 
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MULTIDIMENSIONAL SIGNALS FROM OBSERVED DATA IN WHICH 
MULTIPLE SIGNALS ARE MIXED 
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Commissioner of Patents 
Washington, D.C. 20231 

PRELIMINARY AMENDMENT 

Dear Sir: 

Please amend the above-identified, enclosed patent 
application as follows: 

IN THE SPECIFICATION 

Please delete the paragraph starting on page 1, line 19 
through page 2, line 8, and replace with the following 
replacement paragraph: 

As seen in an example of the observation of multiple 
frames in which text have been overwritten on a 
background image for such as moving pictures, there are 
situations where multiple multidimensional signals that 
are originally independent are mutually mixed and 
observed in plural conditions. A technique for 



determining signals prior to mixture only from observed 
signals, in which multiple multidimensional signals have 
been mixed mutually, is expected to be used in various 
fields in the future. These fields include, for 
example, separation between character information and 
image information when acquiring images from a scanner 
or the like, restoration of medical images for 
extracting necessary information, enhancement and 
restoration of blurred images, noise reduction by image 
reconstruction using feature extracting components of 
observed images contaminated by noise, classification 
and recognition of face data and multidimensional data 
using feature extracting components of observed 
multidimensional signals such as an image, etc. 

Please delete the paragraph starting on page 2, line 25 
through page 3, line 13, and replace with the following 
replacement paragraph: 

Fig. 1 shows two signal sources Si and s 2 by way of 
example. For this, n linear weighted sums Xi(t), 
x„(t) are to be observed, which is expressed as follows 
and observed by an observation apparatus. 
[Equation 1] 

x(t) = As(t) 

where each element is represented as follows. 
[Equation 2] 

2^t) = [Xi(t)X2(t)---X J1 (t)] T 

^t)=[si(t)s 2 (t)--.s m (t)] r 

where it is assumed to be n^m. Furthermore, assuming 
that nxm mixing matrix is A_, which is to be a full rank 
matrix, i.e., a matrix where an inverse matrix of mxm 
matrix A H A exists. Hereinafter, a lowercase letter 
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with an underline represents a vector, an uppercase 
letter with an underline represents a matrix, a 
superscript T represents transposition, and a 
superscript H represents Hermitian conjugate (i.e., 
conjugate transposition) . 

Please delete the paragraph starting on page 4, line 19 
through page 5, line 23, and replace with the following 
replacement paragraph: 

However, as the probability distribution of original 
signals is practically unknown, the mutual information 
can not be made directly to be an object of minimization 
operation. Therefore, the signal separation is often 
performed by optimizing a valuation amount that is equal 
or approximately equal to the mutual information. For 
example, literature 1 "International Journal of Neural 
Systems", vol. 8, Nos. 5 & 6, pp. 661-678, 
October/December 1997, describes that a mutual 
information is able to be minimized if finding a 

transformation matrix W_ that optimizes the sum of the 
fourth-order cumulants with a zero time delay for each 
original signal (i.e., maximizing if the kurtosis is 
positive or minimizing if the kurtosis is negative) , on 
the condition that the observed signals have a kurtosis 
with the same sign, a covariance matrix is bounded, 

whitening has been performed, and a separation matrix W_ 

is a unitary matrix (i.e., K H ¥L == X (unit matrix)). Note 
that the kurtosis refers to a numeric obtained by the 
following calculation for an observed signal u± . 
[Equation 5] 

where £[•] represents an expectation operation. The 



whitening means making signal vectors uncorrelated each 
other to make the variance 1, the fourth-order cumulant 
is a statistic represented by the following equation. 
[Equation 6] 

c 4 (*i, *2/ k 3 )^E{u i (t)u 1 (t-¥k 1 )u i (t + k 2 )u i (t + k 3 )} 

-E{u i (t)u i (t + k 1 )}E{ui(t + k 2 )u i (t + k3)} 
-E{u i (t)u i (t + k 2 )}E{u i (t + k 1 )u i (t + k 3 )} 

-E{u i (t)u 1 (t + k 3 )}E{u i (t + k 1 )Ui(t + k 2 )} 
The zero time delay means that ki, k 2 and k 3 are zero in 
the above equation . 



Please delete the paragraph starting on page 15, line 5 
through page 16, line 2, and replace with the following 
replacement paragraph: 

A signal separation method according to the invention is 
applied to the field of extracting an accurate change of 
brain activity when restoring a medical image to extract 
necessary information from medical images such as fMRI 
(functional magnetic resonance imaging) . It is also 
applied to extraction of an original image prior to 
blurring by enhancing and restoring a blurred image, or 
noise reduction by means of image reconstruction using 
feature extracting components of an observed image that 
is contaminated by noise. Furthermore, it is conceivable 
that the present invention will be applied to 
classification and recognition of face data or 
multidimensional data by means of feature extracting 
components of observed multidimensional signals of images 
or the like, including face recognition in biometrics or 
geographic analysis from satellites. That is, a signal 
separation method according to the present invention is 
widely applicable to a problem that needs to separate 



original signals only from signals where a general 
multidimensional signal train is observed in mixed state, 
irrespective of the state of the digital observed signals 
or analog observed signals, complex signals or real 
signals, etc., wherein the application of its derivative 
forms may be widely derived, so being not limited to the 
above examples. Note that a signal separation technique 
according to the present invention can be useful with a 
dedicated apparatus or a terminal, as well as a computer 
system having a variety of memories, controllers, and a 
display, etc. 

Please delete the paragraph starting on page 17, line 14 
through line 24, and replace with the following 
replacement paragraph: 

In addition, though various proposals have been provided 
as to what kind of nonlinear function should be used, it 
is common to use threshold processing for changing a 
function to be used depending on whether the kurtosis of 
the observed signals is positive or negative, thereby 
selecting a function that enables an appropriate 
approximation of high order cumulants. Other various 
types of forms are also conceivable. Functions to be 
used include tanh(u), u 3 , or u-tanh(u), etc. For 
example, u-tanh(u) is used when the kurtosis is positive, 
while tanh(u) is used when the kurtosis is negative. 

Please delete the paragraph starting on page 19, line 17 
through page 20, line 5, and replace with the following 
replacement paragraph : 

In the calculation of h(t) 25, h(t) is calculated from 
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P(t-1) at the previous time and y(t). In the 

calculation of g(t) and £ 26, each value is calculated 
using a forgetting factor ft. This forgetting factor 
is a constant of 0<^1, which may be usually 1, 
however, when a matrix JV_ to be estimated varies with 
time, this forgetting factor /? is set to smaller than 1 
such as 0.99 or 0.98 to enable tracking for this 
varying. In the calculation of P(t) 27, P(t) is 
calculated, which is an inverse matrix of a covariance 
matrix of y(t), from h(t) calculated in the calculation 
of h(t) 25, input a, the forgetting factor y?, and g(t) 
and £ calculated in the calculation of £(t) and £ 26. 

Note that initial values P(0) and E(0) are arbitrarily 
selected for these algorithms. 

Please delete the paragraph starting on page 21, line 12 
through line 23, and replace with the following 
replacement paragraph: 

The algorithm shown in Fig. 4 is represented as follows. 
[Equation 13] 

yi(t)=f(^i H (t-l)^(t)) 

a= 1 -y~ 2 

ei(t)=££i(t)-wi(t-l)yi(t) 

€- M(t-i)««yi(t)"yi(t) 

_^ i, i yi(t)*yi(t) . 

di(t) -fi\ di(t-i) °C di(t-i)tfai(fr-i)*yi(t)"yi(t)} * 

^(t)=p^(t-l)+£i(t)Iyi(t)V{/?d i (t-l)+yi(t)yi(t)*}] 

x i+ i(t)=Xj(t)- yi(t)yi(t) 
where di(0) is any initial value, a superscript * 
represents conjugate. f(0 represents a nonlinear 
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function such as tanh(-)- 

Please delete the paragraph starting on page 21, line 24 
through page 22, line 9, and replace with the following 
replacement paragraph: 

In Fig. 4, a flow of main algorithm is represented by a 
nonlinear function 41, calculation of an error signal 

ei(t) 42, update of WiO 43, and update of Xi±l(t) 45, 
wherein various amounts necessary for this main 
algorithm are calculated by each unit including 
calculation of £ 46 and calculation of ck(t) 47. z" 1 is 
a delay for timing adjustment. The accuracy is enhanced 
by performing a unitarization operation when each is 
found or when all are found. For example, in the 

case of a real vector, Gram-Schmidt orthogonalization 
process may be applied, however, there is no need to 
restrict a method. 

Please delete the paragraph starting on page 32, line 13 
through line 24, and replace with the following 
replacement paragraph: 

3) Noise reduction by the image reconstruction using 
feature extracting components of the observed images 
contaminated by noise 

After classifying the observed images contaminated by 
noise into some independent components by the independent 
component analysis, noise reduction is performed by 
removing the components that are regarded as noise and 
synthesizing using an inverse matrix of the separation 
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matrix. As the method of the present invention has 
tolerance to noise, more accurate independent components 
than the prior art can be extracted, thereby allowing 
more efficient noise reduction. 



Please delete the paragraph starting on page 35, line 5 
through line 21, and replace with the following 
replacement paragraph: 

[Description of the Symbols] 

21: Nonlinear function 

22: Calculation of error signal e(t) 

23: Update of W(t) 

24: Unitarization operation 

25: Calculation of h(t) 

26: Calculation of g(t) and f 

27: Calculation of P(t) 

31: Estimation filtering of wi(t) 

32: Estimation filtering of ^(t) 

33: Estimation filtering of w^t) 

41: Nonlinear function 

42: Calculation of error signal gj(t) 

43: Update of ^i(t; 

45: Update of Xj+i (t) 
46: Calculation of f 
47: Calculation of ck(t) 



REMARKS 



In accordance with 37 C.F.R. §1.121 (as amended on 
11/7/2000) the specification replacement paragraphs above 
are shown on separate pages marked up to show all the 
changes relative to the previous version of that section. 




Perman & Green, LLP 
425 Post Road 
Fairfield, CT 06430 
(203) 259-1800 
Customer No.: 2512 
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Application No,: 954-010483-US (PAR) 



Marked Up Specification Replacement Paragraphs 



Page 1, line 19, through page 2, line 8. 

As seen in an example of the observation of multiple 
frames in which text have been overwritten on a 
background image for such as moving pictures, there are 
situations where multiple multidimensional signals that 
are originally independent are mutually mixed and 
observed in plural conditions . A technique for 

determining signals prior to mixture only from observed 
signals, in which multiple multidimensional signals have 
been mixed mutually, is expected to be used in various 
fields in the future. These fields include, for 
example, separation between character information and 
image information when acquiring images from a scanner 
or the like, restoration of medical images for 
extracting necessary information, enhancement and 
restoration of blurred images, noise reduction by image 
reconstruction using feature extracting components of 
observed images i n t o. rf e- red -contaminated by noise, 
classification and recognition of face data and 
multidimensional data using feature extracting 
components of observed multidimensional signals such as 
an image, etc. 

Page 2, line 25 through page 3, line 13. 



Fig. 1 shows two signal sources s 2 and s 2 by way of 
example. For this, n linear weighted sums Xx(t), 
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x n (t) are to be observed, which is expressed as follows 
and observed by an observation apparatus. 
[Equation 1] 

x(t) = As(t) 

where each element is represented as follows. 
[Equation 2] 

x(t)=[x 1 (t)x 2 (t)...x i3 (t)] r 

sCt) = [s 1 (t)s 2 (t>.-S ra (t)F 

where it is assumed to be n^m. Furthermore, assuming 
that nxm mixing matrix is A_, which is to be a full rank 
matrix, i.e., a matrix where an inverse matrix of mxm 
matrix A H A exists. Hereinafter, a lowercase letter 
with an underline represents a vector, an uppercase 
letter with an underline represents a matrix, a 
rmhncript superscript T represents transposition, and a 
mibncript superscript H represents Hermitian conjugate 
(i.e., conjugate transposition). 



Page 4, line 19 through page 5, line 23. 

However, as the probability distribution of original 
signals is practically unknown, the mutual information 
can not be made directly to be an object of minimization 
operation. Therefore, the signal separation is often 
performed by optimizing a valuation amount that is equal 
or approximately equal to the mutual information. For 
example, literature 1 "International Journal of Neural 
Systems", vol. 8, Nos . 5 & 6, pp. 661-678, 
October/December 1997, describes that a mutual 
information is able to be minimized if finding a 
transformation matrix W_ that optimizes the sum of the 
fourth-order cumulants with a zero time delay for each 
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original signal (i.e., maximizing if the kurtosis is 
positive or minimizing if the kurtosis is negative) , on 
the condition that the observed signals have a kurtosis 
with the same sign, a covariance matrix is bounded, 
whitening has been performed, and a separation matrix W_ 
is a unitary matrix (i.e., K H K=L (unit matrix)). Note 
that the kurtosis refers to a numeric obtained by the 
following calculation for an observed signal u±. 
[Equation 5] 

E{u*}-3[E{u ± 2 }] 2 
where £[•] represents an expectation operation. The 
whitening means making signal vectors uncorrelated each 
other to make the variance 1, the fourth-order cumulant 
is a statistic represented by the following equation. 
[Equation 6] 

c 4 (*i, k 2 , k 3 ) = E{u i (t)u i (t + k 1 )u i (t + k 2 )u i (t + k 3 )} 

~E{u i (t)u i (t + k 1 )}E{u i (t + k 2 )u i (t + k 3 )} 

-E{u 1 (t)u i (t + k 2 )}E{u i (t + k 1 )u 1 (t + k 3 )}_ 
-E{u i (t)u i (t + k 3 )}E{u i (t + k 1 )u i (t + k 2 )l_ 

The zero time delay means that k lf k 2 and k 3 are zero in 

the above equation. 



Page Page 15, line 5 through line 13. 

A signal separation method according to the invention is 
applied to the field of extracting an accurate change of 
brain activity when restoring a medical image to extract 
necessary information from medical images such as fMRI 
(functional magnetic resonance imaging) . It is also 
applied to extraction of an original image prior to 
blurring by enhancing and restoring a blurred image, or 
noise reduction by means of image reconstruction using 
feature extracting components of an observed image that 
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.j^t-e-r-fer-edis contaminated by noise. Furthermore, it is 
conceivable that the present invention will be applied to 
classification and recognition of face data or 
multidimensional data by means of feature extracting 
components of observed multidimensional signals of images 
or the like, including face recognition in biometrics or 
geographic analysis from satellites. That is, a signal 
separation method according to the present invention is 
widely applicable to a problem that needs to separate 
original signals only from signals where a general 
multidimensional signal train is observed in mixed state, 
irrespective of the state of the digital observed signals 
or analog observed signals, complex signals or real 
signals, etc., wherein the application of its derivative 
forms may be widely derived, so being not limited to the 
above examples. Note that a signal separation technique 
according to the present invention can be useful with a 
dedicated apparatus or a terminal, as well as a computer 
system having a variety of memories, controllers, and a 
display, etc. 



Page 17, line 14 through line 24. 

In addition, though various proposals have been provided 
as to what kind of nonlinear function should be used, it 
is common to use threshold processing for changing a 
function to be used depending on whether the kurtosis of 
the observed signals is positive or negative, thereby 
selecting a function that enables an appropriate 
approximation of high order cumulants. Other various 
types of forms are also conceivable. Functions to be 
used include tanh(u), u 3 , or u-tanh(u), etc. For 
example, u-tanh(u) is used when the kurtosis is positive, 
while_tanh (u) is used when the kurtosis is negative. 



14 



Page 19, line 17 through page 20, line 5. 

In the calculation of h(t) 25, h(t) is calculated from_ 
P(t-1) at the previous time and y(t). In the 

calculation of g(t) and £ 2 6, each value is calculated 
using a forgetting factor /?. This forgetting factor £ 
is a constant of O<0£1, which may be usually 1, 
however, when a matrix £. to be estimated varies with 
time, this forgetting factor ft is set to smaller than 1 
such as 0.99 or 0.98 to enable tracking for this 
varying. In the calculation of P(t) 27, P(t) is 
calculated, which is an inverse matrix of a covariance 
matrix of y(t), from h(t) calculated in the calculation 
of h(t) 25, input a, the forgetting factor P, and g(t) 
and f calculated in the calculation of g(t) and £ 26. 

Note that initial values P(0) and £(0) are arbitrarily 
selected for these algorithms. 



Page 21, line 12 through line 23. 

The algorithm shown in Fig. 4 is represented as follows. 
[Equation 13] 

yi(t)=f(wi H (t-l)xi(t)) 

a= 1 -y~ 2 

ei(t)=Xi(t)-p^(t-l)yi(t) 

C - £* i (f>-i)My 1 (t)»yi(t) 

_j i , l yi(t)*yi(t) . 

di(t) -pi di(t-l) di(t-l){^d 1 (t-l)+y i (t)*y i (t)> / 
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^(t)=^(t-l)+^ 

x i+1 (t)=Xi(t)-^i(t)yi(t) 

where is any initial value, a 

^b^e c ipt superscript represents conjugate, f(-) 
represents a nonlinear function such as— tanh(-). 



Page 21, line 24 through page 22, line 9. 

In Fig. 4, a flow of main algorithm is represented by a 
nonlinear function 41, calculation of an error signal 

gi(t) 42, update of Wi(t\_4 3, and update of Xj+i (t) 45, 
wherein various amounts necessary for this main 
algorithm are calculated by each unit including 

calculation of £, 46 and calculation of dj(t) 47. z _1 is 
a delay for timing adjustment. The accuracy is enhanced 
by performing a unitarization operation when each w±{t\ 

is found or when all are found. For example, in the 

case of a real vector, Gram-Schmidt orthogonalization 

process may be applied, however, there is no need to 
restrict a method. 



Page 32, line 13 through line 24. 

(3) Noise reduction by the image reconstruction using 
feature extracting components of the observed images 
j^¥tej^#e^e dcontaminated by noise 

After classifying the observed images 

-i-nt-e-r-f e-r-edcont aminat ed by noise into some independent 
components by the independent components- analysis, noise 
reduction is performed by removing the components that 



in 
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are regarded as noise and synthesizing using an inverse 
matrix of the separation matrix. As the method of the 
present invention has tolerance to noise, more accurate 
independent components than the prior art can be 
extracted, thereby allowing more efficient noise 
reduction. 

Page 35, line 5 through line 22. 
[Description of the Symbols] 



21 : 


Nonlinear function 




99 • 


Calculation of error 


signal e.(t) 


23 : 


Update of W(t) 




24 : 


Unitarization operation 


25: 


Calculation of h(t) 




26: 


Calculation of g(t) and £ 


27: 


Calculation of P(t) 




31 : 


Estimation filtering 


of Wi(t) 


32: 


Estimation filtering 


Of W2(t) 


33: 


Estimation filtering 


of wJit) 


41: 


Nonlinear function 




42: 


Calculation of error 


signal gi(t) 


43: 


Update of Wi(tX 




45: 


Update of Xi+i(t) 




46: 


Calculation of £ 




47 : 


Calculation of dj(t) 





